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Abstract. Let G be a connected, semisimple Lie group with finite center and let if be a 
maximal compact subgroup. We investigate a method to compute multiplicities of if-types 
in the discrete series using a rational expression for a generating function obtained from 
Blattner's formula. This expression involves a product with a character of an irreducible 
finite dimensional representation of K and is valid for any discrete series system. Other 
results include a new proof of a symmetry of Blattner's formula, and a positivity result 
for certain low rank examples. We consider in detail the situation for G of type split G2. 
The motivation for this work came from an attempt to understand pictures coming from 
Blattner's formula, some of which we include in the paper. 



1. Introduction 

In 0, a proof of a formula for the restriction of a discrete series representation (see ||) 
of a connected, linear, semisimple Lie group to a maximal compact subgroup is given. This 
formula was first conjectured by Blattner. We recall the formula and its context briefly, from 
the point of view of root system combinatorics. 

Throughout the paper, g denotes a semisimple Lie algebra over C with a fixed Cartan 
subalgebra f). Let $ := $(g, fj) denote the corresponding root system with Weyl group W g . 
Choose a set, $ + , of positive roots and let II := {ai, • • • , a r } C $ be the simple roots. Let 
$- = _$+. 

We assume that there exists a function 6 : $ — > Z 2 such that if 71,72 G 3> and 71 + 72 G $ 
then 0(71 +72) = #(71) + 0(72)- This map provides a Z 2 -gradation on $. We set: 

$ c := {7 G $1^(7) = 0}, 
$ nc := {7 G $^(7) = 1}. 

Given a G $, set g Q = {X G g | [H, X] = a(H)X Vff G ()}. Let t := f) ffi E Qe * c 0° and 
p := X] a e*„ c Q - Then, 6 will be a reductive symmetric subalgebra of g with g = t © p the 
corresponding Cartan decomposition of g. As defined, 1) is a Cartan subalgebra for t so rank 
6 = rank g. Each equal rank symmetric pair corresponds to at least one Z 2 -gradation in this 
manner, and conversely. 

We shall refer to the elements of $ c (resp. $ nc ) as compact (resp. noncompact). The 
compact roots are a sub-root system of $. Let := $ + n$ c , $+ c := <3> + n<I> nc , II C := IIn$ c , 
and Il nc :=lln $ nc . Set p s := p c + p nc where p c := \ J2 a e®+ a and = \ Y^ a e<b+ C a - If 
there is no subscript, we mean p = p c . 

We remark that the Z 2 -gradation 9 is determined by its restriction to II. Furthermore, to 
any set partition II = 111 [+J Il 2 there exists a unique Z 2 -gradation on $ such that Il c = ITi 
and Ii nc = n 2 . 
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We denote the Killing form on g by (,), which restricts to a nondegenerate form on f). 
Using this form we may define i : I) — > I)* by i(X)(— ) = (X, — ) (X G ()), which allows us to 
identify f) with f)*. Under this identification, we have i(H a ) = =: a v , where H a G f) is 
the simple coroot corresponding to a G II. 

For each a G $, set = £ — (£,a v )a (for £ G f)*) to be the reflection through the 

hyperplane defined by a v . For G II, let Sj := s ai , be the simple reflection defined by «j. 
Define to be the set of simple roots in and let We denote the Weyl group generated 
the reflections defined by lie- Let W c = (s a \a G Il c ) be the parabolic subgroup of W s defined 
by the compact simple g-roots. Note that W c C We, but we do not have equality in general. 
For w G We, set £(w) := |w;(<I>+) fl <3>~|. Note that there is also a length function on W g 
(denoted £ s ) but £ refers to We- 

A weight £ G f)* is said to be ^-dominant (resp. g-dominant) if (£, a) > for all a G IJ{ 
(resp ot G II). A weight £ G (}* is g-regular (resp. 6-regular) if (£, a) 7^ for all a G $ (resp. 
a G $ c ). The integral weight lattice for g is denoted by the set 

P(q) = {£ e l)*l(£> ftV ) e ^ f° r & 11 a e n g }. Similarly we let P(t) denote the abelian group of 
integral weights for t corresponding to lit. Let the set of t- and g-dominant integral weights 
be denoted by P+{%) and -P+(g) respectively. To each element 5 G P+(t) (resp. P + (g)), let 
Le(S) (resp. L g (S)) denote the finite dimensional representation of t (resp. g) with highest 
weight 5. 

Next, let Q : P{1) N denote the $+ -partition function. That is, if f G P(fi) then Q(f) is 
the number of ways of writing £ as a sum of noncompact positive roots. Put other way: there 
exists an algebraic torus, T, such that to each (jl G P(t) there corresponds a linear character 
of T, denoted e M , with differential fi. Thus, Q defines the coefficients of the product: 

E^) e? = n (i-^r 1 - 

Finally, we define the Blattner formula. For 8, \i G P(£), 



It is convenient to introduce the notation w.£ = w(£ + p) — p for to G Wt and £ G f)*. It is 
easy to see that B(v.5,fi) = (—1)^5(5, /x). Since for all 5 G P(t) there exists t> G We such 
that t>.(5 G P+{£), we will assume that 6 G -P+(t). 

Historically, Blattner's formula arises out of the study of the discrete series and its gener- 
alizations (see |0-§, 0-0, 

Theorem 1 (See [0]). Assume A = A(/z) := fi — p nc + p c is Q-dominant and Q-regular. Then, 
B(5,p) is the multiplicity of the finite dimensional ^-representation, Li{5), in the discrete 
series representation of G with Harish- Chandra parameter A. 

In this paper, we do not impose the g-dominant regular condition on A(/i). This is natural 
from the point of view of representation theory as it is related to the coherent continuation 
of the discrete series (see [0, Jl2| and [|15[1 ). 



From our point of view, the goal is to understand the Blattner formula in as combinatorial 
fashion as possible. Thus it is convenient to introduce the following generating function: 
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Definition. For 5 G P+(t) we define the formal series: 

net)* 

The main result of this paper is Proposition ^|of Section |], which states: For 5 G P+(t), 



b(S) = ckL t (S) 



n 76 $+(i-e" 



rw 1 -^ 7 )' 

where chLj(<5) denotes the character of Lt(5). 

Of particular interest are the cases where Il c 7^ 0, which we address in Section |3|. From 
the point of view of representation theory these include, for example, the holomorphic and 
Borel-de Siebenthal discrete series (see f7|). More recently, the latter has been addressed in 

The Blattner formula for the case of Il c = is often particularly difficult to compute 
explicitly when compared to, say, the cases corresponding to holomorphic discrete series. The 
n c = case corresponds to the generic discrete series of the corresponding real semisimple 
Lie group. In Section ^ we explore this situation in some detail for the Lie algebra G2. 

Finally, in light of Theorem p] one may observe that if 5 G P+(t) and A(/x) is g-dominant 
regular then B(5, fx) > 0. Our goal is to investigate the positivity of Blattner's formula 
using combinatorial methods. Of particular interest is the positivity when we relax the g- 
dominance condition on A(/i). Some results in this direction are suggested by the recent 



work of Penkov and the second author (see ITD ) 



In Section [5] we prove the existence of a skew symmetry of Blattner's formula that exists 
whenever Il c 7^ 0. Thus, the condition that Il c = is necessary for B(5,fi) > for all 
5 G P+(t) and \i G P (I). In the situation where Il c = we introduce the following: 

Definition. We say that a semisimple Lie algebra is b-positive if the Blattner formula corre- 
sponding to the Z2-gradation with Il c = has the property that: 

B(5, y) > for all 5 G P+(l) and G P(t). 

The terminology stems from the fact that a simple Lie algebra is b-positive if and only if 
the coefficients of h(8) are non-negative for all S G P+{t)- Since the character of L%(5) can 
be written as a non- negative integer combination of characters of T, we have that b(5) has 
non-negative integer coefficients if b(0) does. Thus the question of b-positivity reduces to 
the case of 5 = 0. In Section |5|, it is shown that the only b-positive simple Lie algebras are 
of type Ai, A 2 , A3, B 2 , C3, D 4 and G2. We prove this result by examining the coefficients 
ofb(0). 
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2. Proof of the Main Result 
Proposition 2. For 5 G P+{1), 



b(6) = ch U{5) 



rwa-^) 



where ch L^(8) denotes the character of L${8). 

Proof. From the definition of Blattner's formula we have: 

b W = EE (-lY iw) Q(w(5 + p)-p- fief*. 

First we make the substitution, /i = it;(<5 + p) — p — £, and reorganize the sum: 
b(5) = (_i)'(«0 g(f) e «(*+p)-p-* 

= ^ (_i)/(«) e «(«+P)-P ^ Q(£)eT* 

^ e ^ (_i^(t") e w(<y+p)-/t> 

As is well known, the character may be expressed using Weyl's formula (see as in 

the following: 



ch L t {5) 



j2 eW (-iyM e w ( s +p)-p 

rwa-e-^) 



□ 



The result allows us to compute the Blattner formula as follows: 

B & fi& = chL t {5) ^ B(0, v)e v . 

Let chLi(<5) = m 7 e 7 an d we obtain: 



Thus for 5 G P+(6) and /i G P(t) we have 

Note that the numbers m 7 are weight multiplicities for the representation L%(5). 
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3. (Skew-) Symmetries of Blattner's Formula 
The main result of this section is: 
Proposition 3. For v G W c : 

B(b~,jj) = B(5, v.fi) if £(v) is even, 
B(5,[i) = —B(5,v.fi) if £(v) is odd. 

Although this is well known to experts, we include our proof as it requires very little 
technical machinery. 

Definition. For w e W g and £ G f}* let Q w (£) := Q(w~ l £). 
Lemma 4. Ifw(Q+ c ) = $+, then Q w = Q. 
Proof. It is enough to show 

which follows from the following calculation: 



= w (IW (1 - e")- 1 ) = U^iAl-e^r 1 



□ 



Lemma 5. For all w G W c , w(§+ c ) = $+ c . 



Proof. Note that W c is the Weyl group of a reductive Levi factor [ of a parabolic subalgebra 
q C g. We have a generalized triangular decomposition q = u~ © l©u + with q = [®u + . The 
noncompact root spaces contained in u + are positive. Furthermore, all noncompact positive 
roots spaces are contained in u + because I C t. The Lie algebra u + is an [-module and 
therefore the weights are preserved by W c . It is this fact that implies that W c takes positive 
noncompact roots to positive roots. We now need to show that W c takes noncompact roots 
to noncompact roots. 

For roots (3 G $ nc and a G $ c , we have the formula 

s a {P) = P ~ ~, 

(a, a) 

with 2 ^a) an integer. Thus, the reflection of a noncompact root across a hyperplane defined 
by a compact root is noncompact. The reflections generate W c . □ 

We now prove the main proposition of this section. 

Proof of Proposition [|. Let v G W c : 

B(8,n) = ^{-l)WQ{w.6-ii) 

= £ {-lY {v ~ lw) Q{{v- l w).5-n). 



By definition, £(v) = £(v Combining this with the definition of the "dot" action we 
obtain: 



£(M = (-i)W E {-lY^Qiv-Ms +p)-p-h) 

wew t 

= (-1)' {v) E (« + p) - P - p)) ■ 

Next, we use the fact that Q = Q v -i using Lemmas [| and |^. The rest is a calculation. 
B(5,p) = (-l)'W ^(-l)^)QK5 + p)-^ + p)) 

= E (-i)^^ + p) - p - ^ + p) + p) 

w£W t 

= E (-!)' H Q + p) - p - + p) - p)) 

4. The case of G 2 



□ 



The following is a complete calculation of b(0) for the case of the Lie algebra g := G 2 
when Il c = 0. Let a and (3 be a choice of noncompact simple roots for G2 with a long and (3 
short. The compact positive roots are <3>+ = {a + /3,a + 3(3}, while the noncompact positive 
roots are = {a, (3,a + 2/3, 2a + 3(3}. Denote the $+ c -partition function by Q : f)* — > Z. 
We have: 

q:=E^) e ^= II C 1 -^) -1 - 
Let x = e~ a and y = e _/3 . Thus, 

1 

^ (1 — x)(l — y)(l — xy 2 )(l — x 2 y 3 ) 

Let the simple reflection corresponding to a (resp. (3) be si (resp. s 2 ). We have four terms 
in Blattner's formula for 5 = 0: 

5(0, fi) = Q{-p) - Q{sxp -p-n)- Q(s 2 p - p - n) + Q{sis 2 p - p - p), 

and our goal will be to close the sum b(0) := Yjueh* ^(^' P) efl - We will do this by multiplying 
by e M and summing over p for each of the four terms. Observe that: 

E3(£)^ = E^-£) e5 - 

£eff (eft* 
Thus, q = X^eh* Q(~0 e ^- Next consider the sum: 



tx^e^p-p-o 
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We make the substitution —p = s\p — p — £ so that the above sum becomes: 

Q{-p)e Slp - p+p = e Slp - p Qi-V)^- 
vet)* f.et)* 

Thus the above sum is equal to e sip_p q, which we denote by Tj. Similarly, we set T 3 := 
e S2p ~ p q and T 3 := e SlS2p - p q, and T := q. Thus, b(0) = T - T x - T 2 + T 3 . 

Now we write the above in terms of x and y. Note that p = a + 2j3, Sip = (3, s 2 p = —(3, 
and from these we can easily see: 

e s *P-P = X y 3 , 

e sis 2 p-p =x 2 y 4_ 

Putting everything together we see b(0) = (1 — xy){l — xy 3 )q. Or equivalently, if p = 
—ka — £(3 then the value of .8(0, p) is the coefficient of x y in: 

(1 - xy){l - xy 3 ) 



b(0) 



[1 - x)(l - y)(l - xy 2 ){l - x 2 y 3 ) 

i y 

+ 



(1 — x)(l — xy 2 ) (1 — y)(l — x 2 y 3 ) 

Note that in the latter expression, it is clear that the coefficients are the series expansion 
are positive. The positivity of the coefficients of h(S) follows from the positivity of the 
coefficients of b(0). The question of positivity for a general semisimple Lie algebra will be 
addressed in Section |5j. 

It is important to note that as we change Il c the b(0) changes as well. For example, when 

n c = {p}, 

(l-x 2 y 3 )(l-y) 



b(0) 



1 — x)(l — xy)(l — xy 2 ){l — xy 3 ) 

1 x x + y + xy 2 



(1 — x)(l — xy 2 ) {1 — x 2 ){l — xy) (1 — x 2 ){l — xy 3 ) 

which we can easily see does not have non-negative integer coefficients. We leave it as an 
exercise to the reader to compute b(0) when Il c = {a}. 

The generating function for other 5 involve multiplying the above product by a polynomial 
in x^z , y^ that represents the character of the corresponding irreducible finite dimensional 
representation of t = SO4. 

One can plot the coefficients of our formal series, as we do next. In all pictures we have 
labeled the scale on the axes and normalized the short root (f3) to have length 1 and be 
positioned at 3 o'clock. The long root a is at 10 o'clock. 

The first two images (Figures 1 and 2) are for the case with Il c = (generic) and correspond 
to 5 = and 5 the highest weight of the standard 4-dimensional representation of so 4. We 
also display the same two <5's in the case when U c = {(3} (Borel-de Siebenthal) in Figures 3 
and 4. These latter two figures clearly display a skew-symmetry addressed Section H. 
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Figure 1: Coefficients of b(0) when IT C = 0. 




Figure 2: b(S) for L SOi {5) the standard rep. (II C = 0) 



8 




-10 -5 5 10 



Figure 3: Coefficients of b(0) when Il c = {/?}. 




-10 -5 5 10 



Figure 4: b(<5) for L S04 (5) the standard rep. (Il c = {/?}) 
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5. b-POSITIVE SIMPLE LlE ALGEBRAS 



We have the following: 

Proposition 6. The only b-positive simple Lie algebras are of type A 1; A 2 , A 3; B 2; C 3 , D 4 
and G 2 . 

To prove the proposition we use the following lemma to exclude the other cases. 

Lemma 7. Let I be the semisimple Levi factor of a parabolic subalgebra of g. Ifg is h-positive 
then [ is also h-positive. 

Proof. It is a consequence of the main proposition that for any rank r simple Lie algebra g 
we may express b(0) as a rational function in xi, ■ ■ ■ ,x r where Xi = e~ ai (recall that ojj is 
the i th -simple root for g). For any j, if we set Xj = in b(0) then the resulting expression is 
b(0) for a semisimple subalgebra of g. It is not hard to see that this subalgebra is the Levi 
factor of the maximal parabolic of g corresponding to a>j. More generally, let 5CII. If we 
set Xi = in b(0) for all at G S then the resulting expression is b(0) for the Levi subalgebra, 
[5, of the corresponding parabolic. Note that the terms in the series expansion for b(0) for 
[5 are also terms in the series expansion of b(0) for g. Thus a negative coefficient in the 
former implies a negative coefficient in the latter. □ 

The proof of Proposition |6] involves a cases-by-case analysis using the main proposition 
expressing b(0) as a product, Lemma |7] and the computer algebra package, MAPLE. Recall 
that the b-positivity of G2 was proved in Section |4]. 

5.1. Type A. For sl 2 , we have: b(0) = For sl 3 : 

, . . 1 — Xi Xo Xi X 2 

b(0) = -7^ r = 1 + — ^— + ' 



(1 — X±) (1 — X2) 1 — X\ 1 — X2 

And for 5 [4: 

b ^ _ (1 - XjX 2 ) (1 - x 2 x 3 ) _ 1 ^ x 2 



1 - x x ) (1 - x 2 ) (1 - x 3 ) (1 - X X X 2 X 3 ) (1 — X 3 )(l — Xi) (1 - x 2 ) (1 - Xi x 2 x 3 ) 

The partial fraction on the right of each of these examples establishes that the coefficients 
are indeed positive. Next we consider sl 5 where we have a negative result. First we note: 

_ (1 - Xi x 2 ) (1 - x 2 x 3 ) (1 - X 3 X 4 ) (1 - Xi x 2 x 3 x 4 ) 

(1 —Xi) (1 — X 2 ) (1 — X 3 ) (1 — X4) (1 — Xi X 2 X 3 ) (1 — X 2 X 3 X4) ' 

for .5I5. We expand in a formal power series and observe that the coefficient of x\x\x\x^ is — 1. 
This means that b-positivity fails for this example. We then also see failure of b-positivity 
for any simple Lie algebra which has A4 as a Levi factor of a parabolic. Thus, we exclude all 
higher rank type A examples as well as B n {n > 5), C n (n > 5), D n {n > 5), E 6 , E 7 and E 8 . 

5.2. Type B. We only need to examine SO5 and SO7. For SO5 we have: 

u/rA l-xix 2 1 x 2 

b (°) = n — rm — rTTi — —r^ = t, — ztttt. — rr + 



^1 - X\) (1 - X 2 ) (1 - Xi x 2 2 ) (1 - X 2 2 ) (1 - Xi) (1 - x 2 2 ) (1 - Xi x 2 2 ) 

Thus the coefficients of the series expansion are non-negative. 
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Now consider so 7 : 

(1 - xi x 2 ) (1 - x 2 x 3 ) (1 - Xi x 2 x 3 2 ) 



b(0) 



(1 - Xi) (1 - x 2 ) (1 - X 3 ) (1 - Xi x 2 x 3 ) (1 - X 2 X 3 2 ) (1 - Xi x 2 2 x 3 2 ) 

Upon expansion we see that the coefficient of X-^X^X^ IS — 1. Thus, we may exclude this and 
higher rank type B examples as they have B 3 as the Levi factor of a parabolic. In particular, 
we may exclude £> 4 , which is the only type B example that has not been excluded yet. We 
also may exclude F 4 for the same reason. 

5.3. Type C. We must examine b(0) for sp 6 and sp 8 as these are the only examples not 
yet addressed. For sp 6 (ie: C 3 ), we have: 

w„x _ (1 - Xi x 2 ) (1 - X 2 X 3 ) (1 - Xi x 2 x 3 ) 

(1 - Xi) (1 - x 2 ) (1 - X 3 ) (1 - Xi x 2 x 3 ) (1 - x 2 2 x 3 ) (1 - Xi 2 x 2 2 x 3 ) ' 
The coefficients are positive as the above expression is equal to: 

1 I Xi X3 _)_ X\ X2 X3 I 

(1— xi) (I-X2 2 x- A ) (1—^3) (l-£i 2 X2 2 xs) (l—x 2 2 x\i) (1— xi 2 X2 2 X3) (1—xi X2 X3) 

X3 I X2 

(I-X2 2 X3) (1-xi 2 X2 2 X3) (l-x 3 ) (I-X2 2 x 3 ) (1-Xl 2 X2 2 x :i ) (1-2:2) ' 

However, we do not have b-positivity for sp 8 , as we see —1 as the coefficient of X^X^XqX ^ 

NUM 
DEN 

NU M := (1 — xi x 2 ) (1 — x 2 x 3 ) (1 — x 3 x 4 ) (1 — X\ x 2 x 3 x 4 ) 
(1 — x 2 x 3 2 Xi) (1 — X\ x 2 2 x 3 2 x 4 ), and 



in b(0) = S where: 



DEN := (1 - xi) (1 - x 2 ) (1 - x 3 ) (1 - x 4 ) (1 - x 1 x 2 x 3 ) (1 - x 2 x 3 x A ) (1 - x 3 2 x A ) 

(1 - X 1 X 2 X 3 Xi) (1 - X 2 X 3 Xi) (1 - X 2 X 2 X 3 Xi). 

5.4. Type D. The only case left is 50g, where we have: 

(1 — x\ X2) (1 — X2 X3) (1 — X2 xa) (1 — x\ X2 x:j X4) 



b(0) 



(1 — Xl) (1 — X2) (1 — Xz) (1 — X4) (1 — XI X2 X3) (1 — XI X2 X4) (1 — X2 X3 Xa) (1 — XI X2 2 X3 X4) 
1 X2 



(1 — Xl X2 2 X3 X4) (1 — Xl) (1 — X3) (1 — X4) (1 — Xl X2 X4) (1 — X2) (1 — X2 X3 X4) (1 — Xl X2 X3) 

Thus the coefficients are non-negative integers. 
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